You don't have to tell them to go away. You can ask them a question they don't like the answer to, then insist that they answer it without morphing the question into another question they would rather answer. If you spot them using dishonesty to weasel their way out of answering your question, give them a guilt trip for it.
Do this until they either leave the JWs, or until they leave you alone.